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Abstract 

In this paper we show how nonlinear internal models can be effectively used in the 
design of output regulators for nonlinear systems. This result provides a significant 
enhancement of the non-equilibrium theory for output regulation, which we have pre- 
sented in the recent paper "Limit Sets, Zero Dynamics, and Internal Models in the 
Problem of Nonlinear Output Regulation" . 
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1 Introduction 

jg ] In the recent paper JJ, we have laid the fonndations for a non-eqnilibrinm theory of non- 
linear output regulation, giving a more general (non-equilibrium) definition of the problem, 
deriving necessary conditions for the existence of solutions, and describing how the necessary 
conditions thus found, complemented with an additional set of appropriate hypotheses, can 
be used in the design of output regulators. 

We recall that, generally speaking, the problem of output regulation is to have the reg- 
ulated variables of a given controlled plant to asymptotically track (or reject) all desired 
trajectories (or disturbances) generated by some fixed autonomous system, known as exosys- 
tem. The hypotheses assumed in [T] for the design of output regulators no longer include the 
assumption, common to all earlier literature, that the zero-dynamics of the controlled plant 
have a globally asymptotically stable equilibrium. Rather, this assumption is replaced with 
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the (substantially weaker) hypothesis that the zero dynamics of the plant "augmented by 
exsosystem" have a compact attractor. In PQ, though, we have retained the (rather strong) 
assumption, itself also common to all earlier literature, that the set of all "feedforward in- 
puts capable to secure perfect tracking" is a subset of the set of solutions of a suitable linear 
differential equation. In this note we show that, within the new framework, the assumption 
of linearity can also be dropped. 

Since this technical note is to be viewed as a continuation of the work pQ, we retain the 
same notation and - to avoid duplication - we refer the reader to a number key concepts 
introduced and/or described in that paper, among which the notion of omega limit set u)(B) 
of a set B, plays a major role. This concept is a deep generalization of the classical concept, 
due to Birkhoff, of omega limit set of a point and provides a rigorous definition of steady-state 
response in a nonlinear system (see PQ for details). 



2 Problem Statement 

In PQ, as an illustration of how the new non-equilibrium concepts can be applied to the 
design of regulators, we have shown how the problem of output regulation can be solved, 
under appropriate assumptions, for a system which can be put in the form 

z = f (z,w) + fi(z,(,w)( 

C = q(z,c,w)+u m 

e = C 1 ] 

y = C, 

with state (z, () e I" x R, control input it G R, regulated output eel, measured output 
w G R and exogenous (disturbance) input w G R r generated by an exosystem 

w = s(w) . (2) 

The functions fo(z, w), fi(z, £, w), q(z, (, w) are C k functions (for some large k) of their ar- 
guments. 

Remark. System (PQ) may look very particular, as it has relative degree 1 between control 
input u and regulated output e. However, the design methodology described in 0, and 
pursued in what follows under much weaker hypotheses, lends itself to a straightforward 
extension to systems with higher relative degree, namely systems having the form of equation 
(33) in pp. Details are somewhat lengthy and for this reason they are not included here. < 

The analysis in pQ was based on three standing hypotheses. The first of these hypotheses 
is that the exosystem is Poisson stable, namely that: 

Assumption 0. The set W C R r of admissible initial conditions for the exosystem (j2J) is 
compact and W = [J w£W u(w). < 
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Letting Z x E C R n x R be the compact set of initial states of for which the problem 
of output regulation is to be solved, the second hypothesis is that the trajectories of the zero 
dynamics of (JTJ), augmented with (J2J), are bounded, namely that: 

Assumption 1. The positive orbit of Z x W under the flow of 

z = f (z,w) 
u> = s(iu) 

has a compact closure, and u(Z x W) C int(Z) x VT. < 
If follows from this assumption that the set 

Aq :=lo(Z x W), 

i.e the cu-limit set - under the flow of (J3J) — of the set Z x W, is a nonempty, compact, 
invariant set which is stable in the sense of Lyapunov and uniformly attracts Z x W. 
The third assumption was that: 

Assumption 2. There exist an integer d and real numbers a , ai, . . . , a^_i such that, for any 
(zo,Wq) G Ao, the solution (z(t),w(t)) of passing through (zq,Wq) at t = is such that 
the function cp(t) := — 0, w(t)) satisfies 

(p (d) + ad-icp^-V + ■■■ + ai^ (1) + a tp = . < 

It is well-known that the function ip(t) considered above is the input needed to keep the 
regulated output e(t) identically zero (so long as e(0) = 0). The assumption above calls 
for the existence of a linear differential equation of which ip(t) be a solution. In this paper, 
we drastically weaken this assumption, by simply calling for the existence of a nonlinear 
differential equation of which ip(t) be a solution, namely: 

Assumption 2-nl. There exists an integer d and a locally Lipschitz function / : JBL d — > R such 
that, for any (z ,wo) G Ao, the solution (z(t),w(t)) of © passing through (zo,Wq) at t — 
is such that the function <£>(i) := — g(z(t), 0, w(t)) satisfies 

<pW + f(ip,<p<- 1) ,---M*- 1) )=0-< (4) 



3 Output Regulation via Nonlinear Internal Models 

We proceed now with the construction of a controller which solves the problem of output 
regulation for system (JTJ). To this end, consider the sequence of functions recursively defined 

as 

Tx(z,w) = -q{z,0, w) , T i+1 (z,w) = —f (z,w) + q^ S ( W ) > 

for i = 1, . . . ,d — 1, and consider the map 

t : R"xM r -> R d 

(z,w) i ^ col(ri(z,w),r 2 (2;,w), . . . ,r d (^,iu)) . 
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If k, the degree of continuous differentiability of the functions in (JTJ), is large enough, the 
map r is well defined and G x . In particular t(Ao), the image of Ao under r is a compact 
subset of WL d , because Aq is a compact subset of R" x l r . 

Let f c : M. d —>■ R be any locally Lipschitz function of compact support which agrees on 
t(Ao) with the function / defined in (HJ), i.e. a function such that, for some compact superset 
S of t(Ao) satisfies 

fc(v) = for all r] E S 
fc(v) = fiv) for all rj E t(A ). 
Note that, by definition, there is a number C > such that 



\fc(v)\<C, for all r] E M d . 
Let now $ c ( - ) be the smooth vector field of M d defined as 



02 

Vd 



\ 



\-fc(Vl,V2, •••,%)/ 



and let T be the R lxd matrix 



T = (1 ••• 0) . 
Trivially, for any (zq,Wq) E Aq the function r(z(t),w(t)) is such that 



(5) 



— Ti(z(t), W(t)) = Ti+i(z(t), w(t)) 

for i = 1, . . . , d — 1. If, in addition, Assumption 2-nl holds, then 
d 



dt 



r d (z(t)Mt)) = -f(r(z(t),w(t))) = -fMz(t),w(t))) ■ 



Thus, if Assumption 2-nl holds, for any (z q ,wq) E Ao the function r(z(t),w(t)) satisfies 

d 



dt 



T(z(t),w(t)) = $ c (T(z(t),w(t))) . 



(6) 



Remark. In other words, the restriction of (jHJ) to Ao, which is invariant under the flow of 
Q, and the restriction of 

V = $M (7) 
to t(Aq), which is invariant under the flow of (J2J), are r-related systems. < 
Moreover, 

q(z, 0, w) — — Tt(z, w) , for all (z, w) E Ao- (8) 
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Consider now a control law of the form 

u = rz + v, w 

with 

v = -ky . (10) 

A simple check shows that, if Assumptions 0, 1 and 2-nl hold, this controller does have the 
internal-model property (see PQ), relative to the set Aq. 
The control of <$T§ by means of (jUJ) results in a system 

z = f (z,w) + fx(z,(,w)( 

i = MO + Gv 1 ' 

w = s(w) , 

which, viewing v as input and ( as output, has relative degree 1 and a zero-dynamics 

z = f (z,w) 

i = ^) + G(-q(z,0,w)-TO 
w = s(w) . 

The asymptotic properties of the latter are summarized in the following results. 
Lemma 1 Suppose Assumptions 0, 1 and 2-nl hold. Consider the triangular system 

z = f (z,w) 

w = s(w) (12) 

Let E C lR d be a bounded subset such that r(^4 ) C int(H). Choose numbers Cq,Ci, . . . , q_i 
such that the polynomial 

p(X) = X d + c d ^X d - 1 + ---c 1 X + c 

is Hurwitz, set 

G = col(c ,ci, . . . ,c d -i) 
D K = diag(/t, k 2 , . . . , K d ) 

and 

G = D k Gq . 

Then, there is a number k* such that, if k > k* , 

graph(r| A) ) = w{Z x W x S) 

under the flow of Alty) . In particular, graph(r|_4 ) is a compact invariant set which uniformly 
attracts Z x W x E. 
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Proof. Set, for convenience, B = Z x W x H. 

First of all, we show that the positive orbit of B is bounded, so that 00(B) is nonempty, 
compact, invariant and uniformly attracts B (see Lemma 2.1 of [I]). To this end, set 

e = ^ , 

and observe that the variable thus defined obeys 

£ = k(A - G T)£ + D- l Bf c {D R l) - G q(z, 0, w) 



(13) 



in which 



.4 



/0 1 



\0 
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It is seen from (J5J) that, for any k > 1 (which we can assume without loss of generality) 
and for any £ G M. d , 

\D- x Bf c {D K t)\<C. 

Thus, the integral curves of ()13|) are maximally defined on the entire real axis. Knowing 
that £(t) exists for any t > 0, and setting 

u(t) = D- l Bf c (D K l(t)) - G o q(z(t),0,w(t)) , 

system ()13|) can be rewritten in the form 

£ = K(A-G r)£ + u. 

Since the matrix (A — G T) is Hurwitz by construction, and u(t) is bounded (by some fixed 
number which only depends on the choice of W and Z), it is concluded that also |£(t)| is 
bounded. As a consequence, £(t) itself is bounded, by number which depends on the choice 
of W, Z and H and of the parameter k. This concludes the proof that the positive orbit of 
B is bounded. 

To find u>{B), consider now the (closed) solid cylinder C = Aq x IR d . A simple argument 
shows that u>(B) C C. In fact, for any point p — (z,w,£) G uj(B), there must exist sequences 
Pk = ( z k, £fc) and t k , with t fc — > 00 as — > 00, such that linn^oo 4>(tk,Pk) = P- Because of 
the triangular structure of (fT2j) . the point (z, w) is by definition in ^4 an d hence (z, w, £) EC. 

It is immediate to see that graph(r|^ ) is invariant for (|12j) . In fact, observe that, for 
any (zq, Wo) E Aq, the solution (z(t),w(t)) of the top two equations of (jUj) passing through 
(^0; w o) a t time t = remains in Ao for all t E M, because the latter is invariant for Q. Thus, 
bearing in mind (jHJ), for all such trajectories the bottom equation of (|12|) can be rewritten 



as 



e = $ c (0 + G(rr(z, w )-ro. 
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Set x{t) — £(t) — T ( z (t), w (t))- Then, using (jOJ), we have 

X = $ C (X + r(z, w)) - $ c (r(z, w)) - GT X ■ (14) 

The point X = is an equilibrium of this equation and, therefore, graph(r|_4 ) is invariant 
for (fT2|) . In particular, for any point p G graph(r|^ ) it is possible to find sequences pk G 
graph(r|,4 ) and with % — > oo as — > oo, such that lim^oo (fi(tk,Pk) = P- This shows 
that graph(r|^ ) C u>(B). 

To complete the proof, we need to show that no point in C \ graph(r|_4 ) can be a point 
of uj(B). For, pick any point po G C \ graph (r|.4 ), i.e. a point po = (zo,Wo,£,o) in which 
(zo,wq) £ Aq and £0 7^ T (zo,wo). The complete orbit of (JEJ) through p is in C, because Ao 
is invariant under ©• Thus, the ^-component of the corresponding trajectory is such that 

X (t) = £(t) - r(z(t),w(t)) obe y s dH> with X(0) ^ 0. 
Set 

X = D^X, 

and observe that the variable thus defined obeys 

X = k(A- G T)x + BA(x, r(z, w), k) (15) 

with 

A(x,i-(z,w),k)) = — f c (D K x + r(z,w)) - f c {r{z,w)) . 

K a L 

Since the function / c (-) is locally Lipschitz, and bounded, there exists a number L such 
that, for any £i,£ 2 G R d , 

l/c(6 + 6)-/c(6)l <*l- 

Thus, for any k> 1, 

\A(x,t(z,w),k))\ < — d L\D K x\ <L\X\- 

On the other hand, the matrix (A — GqT) is Hurwitz by construction and hence there 
exists a positive definite matrix P such that 

P(A - G T) + (A- G TfP = -I . 

From this, it is immediately seen that the function V(x) = X T Px satisfies, along the trajec- 
tories of (JT3J), 

V(x)<-(k-2L\P\)\ X \ 2 . 
If k > 2L\P\, there exist numbers M > and a > 0, both depending on n, such that 

| X (f)| <Me- a '| X (0)|. (16) 

This property can be used to show that no point of C \ graph(r|_4 ) can be a point of 
ui{B). For, suppose by contradiction that a point p = (z ,w ,£, ), with (z ,w ) G .4.0 an d 
£0 7^ T ( z o, , w ), be a point of u(B). Set 

do = I Co - t(z ,Wq)\ . (17) 
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As the trajectory of (|12j) through this point is defined for all £ G M and bounded, there exists 
a number K such that — K for all t < 0. Pick now a number T > such that 

Me~ aT K < 0.5 d . 

Then, using (fTBj) . we obtain 

|£o - r(zb, Wo)| < Me~ aT U-T) - r{z(-T),w{-T))\ < Me~ aT K < 0.5 d , 
which contradicts ()17j) . This concludes the proof of the Lemma. <. 

Lemma 2 Suppose Assumptions 0, 1 and 2-nl /io/d. Choose G as indicated in Lemmas 
with k > k*. If Aq is locally exponentially attractive for ([3J) ; then graph(r|_4 ) is locally 
exponentially attractive for Alty) . 

Proof. To say that Ao is locally exponentially attractive for (jSJ) is to say that there exists 
positive numbers p, A, A such that, for any (z ,w ) in the (closed) set 

A p = {(z,w) eR n xW : dist((>, w),A ) < p} 

the solution (z(t),w(t)) of (jUJ) passing through (zo,wo) at t = is such that 

dist((z(t),w(t)),A ) < Ae~ xt dist((z ,w ),A ) . 

Set, as in the proof of the previous Lemma, xif) = Of) — r(z(t), w(t)). Then, 

X = $ C (X + t(z, w)) - $ c (r(z, w)) - GT X + Gp{z, w) , (18) 

in which 

p(z, w) = Tt(z, w) + q(z, 0, w) . 

From (J8jl. it is seen that the function p(z,w) vanishes on Ao. Since the function in question 
is C 1 and A p is compact, there exist a number N > such that 

\p(z, w)\ < Ndist((z,w),Ao), for all (z,w) G , 

and therefore, if dist((z ,wo), Ao) < p', with p' = p/A, 

\p(z(t),w(t))\ < NAe- xt dist((z ,w ),A ) . (19) 

Changing x into x = D^x in (fTH|) yields (see proof of the previous Lemma) 

X = K ( A - G T)x + BA(x, t(z, w),k) + G p(z, w) 

from which, using again the same Lyapunov function V(x) introduced above and bearing in 
mind (|19|). standard arguments show that, if k > 2L\P\, an estimate of the form 

|*(t)| < Me- &t (\ X (0)\ + dist((z ,w ), Ao)) 
8 



holds, for every x(0) and for every (z ,w ) satisfying dist((zo, w ), Aq) < p'. From this, the 
result follows. < 

As shown in pQ, the properties indicated in these two Lemma (which in were proven 
to hold under the much strunger Assumption 2) guarantee that, if the input v of (fTTjl is 
chosen as in (fTUj). the resulting closed-loop system has the desired asymptotic properties. 

As a matter of fact, the following conclusion holds. 

Proposition 1 Consider system A20\) . Let Z, W be fixed compact sets of initial conditions 
and suppose Assumptions 0, 1 and 2-nl hold. Pick any compact set E as indicated in Lemma 
Q] and any closed interval E of R. Choose G as indicated in Lemma with k large enough 
so that the conclusions of LemmaU\hold. Then, for every e > 0, there exists a number k* 
such that, if k > k* , the positive orbit ofZxWxExEis bounded and there exists i such 
that \e(t)\ < e for all t > t. If, in addition, Aq is locally exponentially attractive for 
then e(t) — > as t — > oo. 

The proof of this Proposition follows a standard paradigm. Changing the variable £ into 
77 = £ — Ge and setting k = k — TG yields a system of the form 

fo(z,w) + fx(z,e,w)e 

$ c (?7 + Ge) - GT(j] + Ge) - Gq(z, e, w) y ' 

q(z, e, w) + Trj — ke . 

This can be viewed as interconnection of two subsystems, one with state (z, w, r/) and input 
e, the other with state e and input (z, w,rj). Then, small-gain arguments can be invoked to 
show that, if k is large enough, the results of the Proposition hold. Details on the proof that 
the subsystems in question have the appropriate input-to-state stability properties can be 
found in j2]. 



z = 

w = 

V = 

e = 
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